Random matrix ensembles and the extensivity of the S q entropy 
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We consider the joint density distribution of the elements of certain random matrix 
models which are example of globally correlated and asymptotically scale-invariant 
distributions. It is shown that in their cases, the nonadditive entropy Sq is extensive 
only when the limit q — )■ 1 is taken. On the other hand, when restriction in the 
occupation of the phase space is imposed extensiveness is obtained for values of the 
entropic parameter different of one. 



I. INTRODUCTION 

In recent studies of random matrix theory (RMT) there has been an interest in a 
family of ensembles which at the same time generalizes the standard Wigner Gaussian 
ensemble and preserves its invariance under unitary transformations [l|. This kind of 
ensembles is generated by superposing to the Gaussian fluctuations, an external source 
of randomness. Accordingly, this family has been named disordered ensembles^. It first 
appeared as a result of applying to RMT the generalized maximum entropy principle [1,0] 
associated to the nonadditive Tsallis S q entropy [El]. Generalized in Ref. @,|6j], this more 
general family can be considered as an instance of the so-called superstatistics[3]. 

Given a set of probabilities pi, the Tsallis nonadditive entropy associated to them is 
defined as 



which, in the q — > 1 limit, recovers the standard Boltzmann-Shannon (BS) entropy 

S 1 = -^pilnpi. (2) 

i 

The nonadditivity of (Tj[|) follows since, for a system composed of two independent sub- 
systems A and B such that the probabilities Pi are product pi = p^p^, Sq 7^ Sa + Sb- 
Therefore, the definition (CQ) breaks the additivity property of the standard entropy. Nev- 
ertheless, it has been claimed (8] that, under certain conditions, S q , though nonadditive, 
asymptotically becomes extensive with respect to the definition j^] 

<| lim -§■ |< oo, (3) 

f^oo f 

where / is the degree of freedom, while S±, under the same circunstance, may or may not 
be nonextensive. It also has been claimed0 that this occurs for systems in which the 
phase space is occupied in a scale- invariant way. We show that, though the criterion of 
scale- invariance is satisfied by the joint density probability of the matrix elements of the 



disordered ensembles, they only become extensive when the q — >■ 1 limit is taken. On the 
other hand, if restriction in the variation of the variables is introduced by forcing them 
to occupy only a fraction of the whole phase space then, situations occur which made 
the nonadditive entropy extensive for values of the entropic parameter different from one. 
Our analysis is peformed, by considering joint density distribution of random variables 
continuous and discrete. 



II. UNRESTRICTED OCCUPATION OF PHASE SPACE 

Our starting point are two random matrices ensembles: the Gaussian Wigner ensem- 
bles for continuous case and for the discrete case, the ensemble of adjacency matrices of 
the Erdos-Renyi model of random graphs. Correlations are then introduced among the 
matrix elements by constructing misture with some appropriate weight of these two type 
of matrices. In both cases, the scale invariant property is verified independent of the 
number of variables. 



A. Disordered Gaussian ensembles 



The joint density probability distribution of the matrix elements of the RMT Wigner 
Gaussian ensemble is 111 
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where / = N + (3N(N — 1)/2 is the number of independent matrix elements for the classes 
of real matrices (/3 = 1), complex matrices (/3 = 2) and quaternion matrices (/3 = 4). 
These three classes form, respectively, invariant Gaussian ensembles under orthogonal 
(GOE), unitary (GUE) and symplectic (GSE) transformations. The above distribution 
is normalized with respect to the measure dH = Yli dHa ]X>i Y\k=i V^dH^. As matrix 
elements in are statistically independent random variables, one should expect that 
their distribution should be additive with respect to the BS entropy and nonadditive and 
nonextensive with respect to S q . In fact, with q ^ 1 we have 
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where, with i = 1,2,...,N, hi = Ha, for the diagonal elements and, with i = N + 
1, N = 2, /, hi = \/2Hij for the off-diagonal forming a set h of / independent random 
variables. Performing the integrals 
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such that it is immediately seen that the ratio S q /f diverges or vanishes in the limit 
/ — > oo. On the other hand, if the limit q — > 1 is first taken we get 



which, as expected, shows additiveness. 

Consider now matrices constructed by the relation 
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where £ is a positive random variable with a normalized density probability distribution 
u>(£) with average £. From (TjJ and (jHJ), the joint density probability distribution 
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follows which, expressed in terms of the reduced set of matrix elements, becomes 



P f (hi,h 2 ,...,h f ) 



2tt£ 



//2 



exp 



2 e f 



(10) 



i=l 



Clearly, h is now a set of / correlated variables with distribution which has the scale- 
invariance property since removing by integration any one of the variables, say hk, pro- 
duces the same joint distribution Pj-i, that is 



dh k P f (hi,h 2 ,...,hf 

The Tsallis entropy of Pf(h) is by definition 

1 
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which through the substitution h! 4 = \ Srhi becomes 
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If the integral in ( TTBl has a finite limit when / — > oo, the entropy will diverge or vanish 
for q 1. In this case, extensivity can only happen if the limit g — >■ 1, is first taken or, if 
the limit / — > oo is taken keeping fixed the quantity 
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In this case, concomitantly we have the limits q — > 1, (q — l)f — > 2 and 
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are implied, where / denotes the limiting value of the integral. 

To illustrate the above discussion, take for the weight function the gamma dis- 
tribution 



w(0 = ex P (-o^Vr(0 (16) 

with variance a% = a/£ of previous studies of disorder ensembles. This choice entails 
power-law behavior for statistic measures of the ensemble. Substituting ( JTBT) in the above 
expressions, the integrals are readily performed such that ( jTOj) gives 



for the ensemble distribution and 
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for the density distribution of a given matrix element. Since for large \h\ , pp{h\^) ~ 
1/ |/i| 2 ^ +1 , the distribution f lT8|) does not have moments of order superior to 2£. This fact 
makes the value £ = 1 critical since below it (|18p does not have second moment |3|]. 
Substituting f lT6|) in f lT3|) . the integrals are easily performed and the analytic expression 



s,U) = — 

for the entropy is obtained. In order to S q be extensive, the second term inside the 
parenthesis has to become proportional to / for very large /. Replacing the gamma 
functions by its Stirling approximation, it is simple to show that this proportionality 
does not happen if q ^ 1. Instead, if first the limit q — > 1 is taken with the degree of 
freedom / fixed, the BS entropy is 
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where ^>(x) denotes the logarithmic derivative of the gamma function. Taking now the 
limit / — > oo, we obtain 
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showing the additiveness of the Boltzmann- Shannon entropy. 

Let us now take the limit / — > oo imposing the condition (|T4|) with A = £ then the 
limit expression 
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for the entropy is obtained (e = 2.71828...) proving its extensivity. In Fig. 1, the exact 
and the asymptotic expressions of the S q entropy are plotted as function of /. 



B. Disordered random graphs 



A graph is an array of points (nodes) connected by edges. It is completely defined by 
its adjacency matrix, A, whose elements, Ay, have value 1(0) if the pair (ij) of nodes is 
connected (disconnected). The diagonal elements are taken equal to zero, i.e. An = 0. 
Adjacency matrices are real symmetric random matrices for graphs in which the con- 
nections between pairs of nodes are randomly set. The classical graph of this kind was 
proposed by Erdos and Renyi (ER) in which pair of nodes are independently connected 
with a fixed probability The properties of this classical model are strongly depen- 

dent on the value of the probability p compared with the total number of nodes N and it 
is usual to assume the scaling p ~ N~ z (z > 0). Two important statistical properties in 
the studies of graphs are the eigenvalue density of the adjacency matrix and the degree 
probability that gives the probability distribution of the number of connections of a given 
node. 

For not too small values of p, that is not too rarefied ER graphs, the eigenvalue density 
obeys the Wigner semi-circle lawp], [Io[ 
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where 



a 2 =p(l-p) (24) 

is the variance of the matrix elements. Deviations from this law appear 12j, [13j if p ~ 1/N 
(z ~ 1). The degree distribution, that is the number fc, of connections of a given node i 
is obtained from the adjacency matrix as 



N 
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and the probability of having ki equal to k is 

For large N, it can be assumed that the nodes are statistically independent in such a 
way that ( 126|) also gives the probability of finding the average number of nodes with k 
connections in the graph (lo|. 

In Ref. {2}, it has been shown that the joint distribution of the matrix elements of the 
ER adjacency matrix can be written in terms of its trace as 

P ER (A, a) = [l + exp(-a)]- / exp (-f trA 2 ) (27) 

where / = JV ^~ 1 ^ is the number of independent matrix elements for a graph with N 
nodes. Eq. ( 1271) shows that the ER model can be considered as a special case of the RMT 
Gaussian ensembles in which matrix elements are Bernoulli random variables. Focussing 
only on the set CL — CLi, 0,2, CLf of / independent elements, ( 12"71) becomes 



Per{o) = [1 +exp(-a)] / exp 
from which the probability of one given element, say a k , is 
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between the parameter a and the probability p. Since p is defined in the interval [0, 1], 
the correspondent domain of variation of a is (oo, — oo). 

As a is a set of binary discrete variables, the joint probability P ER (a, a) has a finite 
set of / + 1 possibilities which can be arranged in the Leibnitz triangle 
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which has the property of adding two adjacent entries of a row, the above entry on 
the immediate row is obtained. This property is equivalent to say that the probability 
distribution, Eq. (1251) . is scale- invariant [8J]. As the set a is also statistically independent, 
the BS entropy of its distribution should be extensive. In fact, the nonadditive entropy 
of P5|) is easily calculated to be given by 
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which divide by /, diverges or vanishes in the limit / — >ooifg<lorg>l, respectively. 
On the other hand, taking first the limit q — > 1, we find 
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such that the additiviness of BS entropy follows. 

Proceeding as in the Gaussian ensemble, correlations are introduced in the ER model 
by defining a disordered model constructed by superposing with a given weight ER graphs 
with different probabilities. Explicitly, we consider a random graph whose adjacency 
matrix has joint distribution of elements given by 
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Eq. (I33p extends to discrete variables the formalism defined by Eq. (Q. Again the width 
of the distribution of is a controling parameter but here the parameter a defining 
the mean ER also plays an important role. 



As in the case of the Gaussian ensembles, statistics measures of the averaged graph, 
i.e. the generalized model, are obtained as averages over the statistics measures of the 
ER model. For instance, the eigenvalue density is given by 
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while the degree distribution is given by 
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In terms of the set a of independent matrix elements, (133]) becomes 
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Due to the linearity property of integration, the finite number of probabilities defined by 
(I3"8"|) can also be arranged in a Leibnitz triangle in such a way that the relations between 
elements of neighboring rows are preserved. Therefore, this generalization of the ER 
graph introduces correlation among the variables but their joint probability distribution 
still satisfies the scale-invariant criterion, namely 
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The S q entropy of (|38|) is 
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or, explicitly, 
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To proceed, we choose the weight distribution u>(£) to be given by Eq. ( fl6|) . In Ref. 
it is shown that with this choice the generalized model has features of a scale-free graph. 



(41) 
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In particular, the eigenvalue density exhibits a crossover from the Wigner semi-circle law 
to a distribution highly peaked with heavy exponential tails. 
With this choice, the integral 
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in (T4"Tj) . asymptotically can be calculated in the following way We put the integrand in 
an exponential form exp(— Ff k ) with 
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For £ > 1, Ffk(£) has a parabolic shape such that a new variable t can be introduced 
through the mapping 



Ffk(0 = F fk (Q + 



(44) 



where £ s is the minimum value obtained by finding the root of the equation Ff k (£) = 0. 
In terms of t the integral becomes 
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Replacing d£/dt by its value at t = 0, the asymptotic approximation 
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is obtained which replaced in (|4T|) leads to the asymptotic approximation 
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for the entropy. In Fig. 2, (I47p is plotted as a function of / imposing the condition ( |14p 
with £ = 6. The linear increase shows the extensivity of S q under these condition. 



III. RESTRICTED OCCUPATION OF PHASE SPACE 



The previous section shows that correlations among the random variables are not 
sufficient to make the S q entropy of their joint distribution extensive for g ^ 1. The 
calculations have been performed allowing the variables to freely occupy the phase space 
in an unrestricted way. In this section, we again start considering the Wigner and the 
Erdos-Renyi models but imposing the condition that the random variations of their con- 
stituents are restricted to a region of their phase space. By doing this, we find situations 
in which S q , in both cases, becomes extensive for values of the entropic parameter differ- 
ent from one. The scale-invariant property is asymptotocally obeyed but in a less strong 
form. 



A. Continuous case 



Consider the joint distribution of the matrix elements of the Wigner ensemble, Eq. (T4|), 
but with the additional constraint that the trace is restricted to be less than a maximum 
value R 2 . In terms of the reduced set h of elements this implies in the condition (lo| 
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such that the elements are forced to be inside a hypersphere of radius R. As a consequence, 
the joint density distribution has to be renormalized as 
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with j (a, x) being the incomplete gamma function (l6l|. The entropy of this distribution 
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Replacing the incomplete gamma function by its asymptotic expression 16 
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the entropy assumes the correspondent asymptotic expression 

1 



S a 



q-1 



1 - (irR 2 ) 



2 ,(i-,)//2 n _ 1(1 + //2) 



(53) 



If in this expression, the radius R is made dependent on the degree of freedom / as 



7ri? 2 = (^ + l)exp(-l) 
and the gamma function is replaced by its Stirling approximation 
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the S q becomes 
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Therefore for the value q = 3 of the entropic parameter, S3 increases linearly with / as 

(57) 
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This is illustrated in the figure where S q is plotted as function of / for the values 2,3 and 
4 of the entropic parameter. 

To investigate how the restriction in the occupation of the phase space affects the 
scale-invariant property of the joint density probability distribution, let us integrate it 
over one variable of the set of / variables. As the variables appear equivalently in the 
distribution, we take by convenience the last one, i.e. hf, integrating it over the available 
domain, we obtain the distribution 



/';'(/': /'/ i) = Z/exp f -f J>H 2 jf dh f exp(-|/ij). (58) 



Using the asymptotics of the functions we get 
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At the bulk of the space when / — > oo the error function tends to one. Taking the ratio 
of this distribution with the distribution of for / — 1 after replacing the gamma functions 
by its Stirling approximation we obtain 

Um = [J ( 
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We remark that from Eq. (154")) . R ~ \ff, such that the restricted domain occupied by 
the distribution expands concomitantly with the expansion of the phase space. Therefore, 
asymptotically, in the limit / — > oo, the whole phase space is occupied. 
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B. Discrete case 

Consider now the joint distribution of matrix elements of the adjacent matrix of the 
ER model. Following the same scheme we impose the condition that the the trace can not 
be greater than a value d, that is the variations of the set a of random binary variables 
are constrained to obey the condition 

/ 

^a t = k<d. (61) 
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The probability that the sum be equal to k has to be redefined as 
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In ( 1621) . the normalization constant is given by 
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The entropy of this distribution is 
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For f » d, the sums in ( 163|) and (I64p can be approximated by their last terms as 
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which substituted in (1M|) lead to the approximated expression 
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for the entropy. Immediately we conclude that making 

q = l-\ (68) 

S q becomes extensive in the limit / — > oo. 

To discuss the scale- invariant property of the distribution ( 16 2 p . we first note that 
apart from the normalization Wf(a,d) the expressions are the original probabilities of 
the Erdos-Renyi graph which satisfy the scale-invariant property. Therefore, it is enough 
to consider that extra term, that is the ratio between its value when / changes to / + 1. 
Using its approximation by the last term we obtain 
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which using the relation ( )30|) becomes 
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Assuming that the probability scales as p ~ N~ z , we conclude that the distribution 
satisfies asymptotically the scale-invariant property. 



IV. CONCLUSION 



We discuss the extensivity of the nonadditive entropy, S q , using the joint density 
distribution of certain random matrix ensembles. This entensivity has previously been 
investigated, using artificial distributions constructed with that objective (8j]. Here we are 
studying it resorting to probability distributions of statistical models with applications 
in many area. Our main result is to set the role the restriction in the variations of the 
random variables plays, in order to have extensivity for values different from one of the 
entropic parameter. We also verified that when this happens asymptotically the scale- 
invariant property condition is satisfied. Of course, restriction in the occupation of phase 
space concomitantly entails correlations among the variables. 
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Figure Captions 

Fig 1. Eqs. ([I9]) and f[22|) for the exact and the asymptotic expressions of the S g 
entropy of the disordered (/3 = 1) Gaussian ensemble are plotted, as a function of the 
number of variables /, fixing — j-j- + | = £ with £ = 4. 

Fig 2. The expression of the S g entropy of the disordered adjacency matrices is plotted, 
as a function of number of variables /, fixing -^j + ^ = £ with £ = 6. 

Fig 3. The S g entropy of the restricted {(3 = 1) Gaussian ensemble is plotted as 
a function of the number of variables / for q = 2,3 and 4, The dashed line is the 
approximating asymptotic expression Eq. ( |57|) . 



